Exploit Domain-Robust Optical Flow in Domain Adaptive Video Semantic Segmentation

نویسندگان

چکیده

Domain adaptive semantic segmentation aims to exploit the pixel-level annotated samples on source domain assist of unlabeled target domain. For such a task, key is construct reliable supervision signals However, existing methods can only provide unreliable constructed by model (SegNet) that are generally domain-sensitive. In this work, we try find domain-robust clue more signals. Particularly, experimentally observe domain-robustness optical flow in video tasks as it mainly represents motion characteristics scenes. cannot be directly used since both them essentially represent different information. To tackle issue, first propose novel Segmentation-to-Flow Module (SFM) converts maps flows, named segmentation-based (SF), and then Segmentation-based Flow Consistency (SFC) method impose consistency between SF flow, which implicitly supervise training model. The extensive experiments two challenging benchmarks demonstrate effectiveness our method, outperforms previous state-of-the-art with considerable performance improvement. Our code available at https://github.com/EdenHazardan/SFC.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Robust moving video object segmentation in the MPEG compressed domain

In this paper, we proposed a robust moving video object segmentation algorithm using features in the MPEG compressed domain. We first cluster the motion vectors and produce a motion mask. Then, a difference mask at 8 x 8 block size is extracted from the DC image by background subtraction method. Finally, the motion mask and the difference mask are combined conditionally to generate the final ob...

متن کامل

Compressed Domain Video Segmentation

Segmentation of video into shots and scenes in the compressed domain allows rapid, real-time analysis of video content using standard hardware. This paper presents robust techniques for parsing MPEG-compressed video sequences into shots based on their physical structure and further into scenes based on their semantic structure by identifying changes in content and camera motion. The analysis is...

متن کامل

Video Abstraction in H.264/AVC Compressed Domain

Video abstraction allows searching, browsing and evaluating videos only by accessing the useful contents. Most of the studies are using pixel domain, which requires the decoding process and needs more time and process consuming than compressed domain video abstraction. In this paper, we present a new video abstraction method in H.264/AVC compressed domain, AVAIF. The method is based on the norm...

متن کامل

Compressed Domain Robust Video Watermarking

Recently, video watermarking has become an important research issue due to increase in threats of video piracy, authentication, and ownership integrity. In this paper, we propose a new secure and robust watermarking method for H.264 compressed video stream with a blind extraction process. Most authors prefer embedding in I-frames because I-frames are crucial for video signal. However, the embed...

متن کامل

Video Segmentation in the Wavelet Compressed Domain

Automatic video indexing is an important feature in the design of a video database. Recently, compressed domain techniques have become popular due to their inherent advantages of efficiency and lower complexity. On the other hand, wavelet transform has emerged as a powerful tool for efficient compression of visual information. A variety of wavelet-based video compression techniques have been re...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2023

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v37i1.25140